Analysis of quantile regression as alternative to ordinary least squares

Data Envelopment Analysis as Least-Squares Regression

Data envelopment analysis (DEA) is an axiomatic, mathematical programming approach to productive efficiency analysis and performance measurement. This paper shows that DEA can be interpreted as a nonparametric least squares regression subject to shape constraints on production frontier and sign constraints on residuals. Thus, DEA can be seen as a nonparametric counter-part of the corrected ordi...

Least Quantile of Squares Regression via Modern Optimization

We address the Least Quantile of Squares (LQS) (and in particular the Least Median of Squares) regression problem using modern optimization methods. We propose a Mixed Integer Optimization (MIO) formulation of the LQS problem which allows us to find provably optimal global solutions for the LQS problem. Our MIO framework has the appealing characteristic that if we terminate the algorithm early,...

A risk comparison of ordinary least squares vs ridge regression

We compare the risk of ridge regression to a simple variant of ordinary least squares, in which one simply projects the data onto a finite dimensional subspace (as specified by a principal component analysis) and then performs an ordinary (un-regularized) least squares regression in this subspace. This note shows that the risk of this ordinary least squares method (PCA-OLS) is within a constant...

A Comparison of Ordinary Least Squares and Logistic Regression

Partial least squares regression as an alternative to current regression methods used in ecology

This paper briefly presents the aims, requirements and results of partial least squares regression analysis (PLSR), and its potential utility in ecological studies. This statistical technique is particularly well suited to analyzing a large array of related predictor variables (i.e. not truly independent), with a sample size not large enough compared to the number of independent variables, and ...